CENTRAL LIMIT THEOREM FOR THE EXCITED RANDOM 
WALK IN DIMENSION d>2 

JEAN BERARD^ AND ALEJANDRO RAMIREZ^-^ 

Abstract. We prove that a law of large numbers and a central limit theorem 
hold for the excited random walk model in every dimension d > 2. 



1. Introduction 

An excited random walk with bias parameter p S (1/2, 1] is a discrete time nearest 
neighbor random walk (X„)„>o on the lattice Z"^ obeying the following rule: when 
at time n the walk is at a site it has already visited before time n, it jumps uniformly 
at random to one of the 2d neighboring sites. On the other hand, when the walk 
is at a site it has not visited before time n, it jumps with probability p/d to the 
right, probability {1 — p)/d to the left, and probability l/{2d) to the other nearest 
neighbor sites. 

The excited random walk was introduced in 2003 by Benjamini and Wilson [TJ, 
motivated by previous works of [5lH] and ^lOj on self-interacting Brownian motions. 
Variations on this model have also been introduced. The excited random walk on 
a tree was studied by Volkov [15]. The so called multi-excited random walk, where 
the walk gets pushed towards a specific direction upon its first visits to a site 
X, with Mx possibly being random, was introduced by Zerner in ||l6j (see also |17| 
and [9]). 

In [1 , Benjamini and Wilson proved that for every value of p G (1/2, 1] and d >2, 
excited random walks are transient. Furthermore, they proved that for d > 4, 

(1) liminf • ei > a.s., 

n—+oo 

where {ci : 1 < i < d) denote the canonical generators of the group Z'^. Subsequently, 
Kozma extended ([T]) in |7j and [8j to dimensions d = 3 and d = 2. Then, in pUlj, 
relying on the lace expansion technique, van der Hofstad and Holmes proved that a 
weak law of large numbers holds when d > 5 and p is close enough (depending on d) 
to 1/2, and that a central limit theorem hold when d > 8 and and p is close enough 
(depending on d) to 1/2. 
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In this paper, we prove that the biased coordinate of the excited random walk 
satisfies a law of large numbers and a central limit theorem for every d > 2 and 
pG (1/2,1]. 

Theorem 1. Let p £ (1/2, 1] and d>2. 

(i) (Law of large numbers). There exists v = v{p,d), < v < +oo such that a.s. 

lim n~^Xn ■ ei = V. 

n—^oo 

ill) (Central limit theorem). There exists a = a{p,d), < a < +oo, such that 

t n"^/^(XL„4j • ei -v[nt\), 
converges in law as n ^ +oo to a Brownian motion with variance a^. 

Our proof is based on the well-known construction of regeneration times for the 
random walk, the key issue being to obtain good tail estimates for these regeneration 
times. Indeed, using estimates for the so-called tan points of the simple random walk, 
introduced in [1] and subsequently used in [71 E] , it is possible to prove that, when 
d > 2, the number of distinct points visited by the excited random walk after n 
steps is, with large probability, of order n^/^ at least. Since the excited random walk 
performs a biased random step at each time it visits a site it has not previously 
visited, the ei-coordinate of the walk should typically be at least of order n^/^ after 
n steps. Since this number is o(n), this estimate is not good enough to provide a 
direct proof that the walk has linear speed. However, such an estimate is sufficient 
to prove that, while performing n steps, the walk must have many independent 
opportunities to perform a regeneration. A tail estimate on the regeneration times 
follows, and in turn, this yields the law of large numbers and the central limit 
theorem, allowing for a full use of the spatial homogeneity properties of the model. 
When d > 3, it is possible to replace, in our argument, estimates on the number of 
tan points by estimates on the number of distinct points visited by the projection 
of the random walk on the (e2, . . . , e^) coordinates - which is essentially a simple 
random walk on Such an observation was used in [1] to prove that ([l]) holds 

when d> 4. Plugging the estimates of [6 in our argument, we can rederive the law 
of large numbers and the central limit theorem when d > 4 without considering tan 
points. Furthermore, a translation of the results in and pT| about the volume of 
the Wiener sausage to the random walk situation considered here, would allow us 
to rederive our results when d = 3, and to improve the tail estimates for any d >3. 

The regeneration time methods used to prove Theorem [T] could also be used to 
describe the asymptotic behavior of the configuration of the vertices as seen from 
the excited random walk. Let H := {0, 1}^ equipped with the product topology 
and fj— algebra. For each time n and site x ^ Xn, define /3(x, n) := 1 if the site x 
was visited before time n by the random walk, while f3{x, n) := otherwise. Let 
(^(x, n) := (3(x — Xn, n) and define 

C(n) :=(C(x,n); xGZ'^\{0}) GH. 
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We call the process {({n))n£n the environment seen from the excited random walk. 
It is then possible to show that if p{n) is the law of C(^)) there exists a probability 
measure p defined on H such that 

lim p{n) = p, 

n—^oo 

weakly. 

In the following section of the paper we introduce the basic notation that will 
be used throughout. In Section [3] we define the regeneration times and formulate 
the key facts satisfied by them. In Section [4] we obtain the tail estimates for the 
regeneration times via a good control on the number of tan points. Finally, in Section 
[5j we present the results of numerical simulations in dimension d = 2 which suggest 
that, as a function of the bias parameter p, the speed v{p,2) is an increasing convex 
function of p, whereas the variance a{p, 2) is a concave function which attains its 
maximum at some point strictly between 1/2 and 1. 

2. Notations 

Let b := {ei, . . . , e^, — ei, . . . , — e^}. Let p be the distribution on b defined by 
/x(+ei) = p/d, p{—ei) = (1 — p)/d, p{ it ej) = l/2d for j / 1. Let v be the uniform 
distribution on b. Let Sq denote the sample space of the trajectories of the excited 
random walk starting at the origin: 

5o := [{zi)i>Q e {ZY; zo = 0, z^+i - e b for all i > o} . 

For all k >0, let denote the coordinate map defined on So by Xk{{zi)i>Q) := Zk- 
We will sometimes use the notation X to denote the sequence {Xk)k>o- We let T 
be the cr— algebra on Sq generated by the maps {Xk)k>o- For k £ N, the sub- 
CT— algebra of generated by Xq, . . . , Xk is denoted by J^k- And we let 6k denote 
the transformation on Sq defined by {zi)i>o {zk+i — Zk)i>Q. For the sake of 
definiteness, we let 0+oo((-Zi)i>o) := (•Zi)i>o- For all n > 0, define the following two 
random variables on [Sq,!F): 

rn := max{Xj • ei; < i < n}, 

Jn = Jn{X) := number of indices < /c < n such that X^ ^ {Xi] < i < k — 1}. 

(Note that, with this definition, Jq = 1.) 

We now call Pq the law of the excited random walk, which is formally defined as 
the unique probability measure on (5o,^) satisfying the following conditions: for 
every A: > 0, 

• on Xk ^ {Xi; < i < k — 1}, the conditional distribution of Xk+i — Xk with 
respect to J^k is P', 

• on Xk G {Xi; < i < k — 1}, the conditional distribution of Xk+i — Xk with 
respect to J^k is i^- 
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3. The renewal structure 

We now define the regeneration times for the excited random walk (see [Mj for 
the same definition in the context of random walks in random environment). Define 
on {So,J^) the following (^fc)fc>o-stopping times: T{h) := infj/c > 1; • ei > h}, 
and D := inf{fc > 1; • ei = 0}. Then define recursively the sequences {Si)i>o 
and (A)j>o as follows: Sq := r(0), Dq := Sq + D o Og^^, and Si+i := T^rOi), 
Di^i := Si-^-i + DoOsi^i for i >0, with the convention that 5*4+1 = +oo if Z?j = +oo, 
and, similarly, -Dj+i = +oo if S'j+i = +cxd. Then define K := inf{i > 0; = +00} 
and K := Sk (with the convention that k = +00 when K = +00). 

The key estimate for proving our results is stated in the following proposition. 

Proposition 1. As n goes to infinity, 

Fo{k >n)< exp (^-nT9 + . 

A consequence of the above proposition is that, under ¥q, k has finite moments of 
all orders, and also X^, since the walk performs nearest-neighbor steps. We postpone 
the proof of Proposition [T] to Section |4} 

Lemma 1. There exists a 5 > such that ^q{D = +00) > 5. 

Proof. This is a simple consequence of two facts. Firstly, in [T| it is established that 
Po-a.s, limfc^_(_oo X(/c) • ei = +00. On the other hand, a general lemma (Lemma 9 
of [IZ]) shows that, given the first fact, an excited random walk satisfies PoiD = 
+00) > 0. 

□ 

Lemma 2. For all h>0, Fo{T{h) < +00) = 1. 

Proof. This is immediate from the fact that Po-a-s., limfc_^+oo ^{k) ■ e\ = +00. □ 

Now define the sequence of regeneration times (Kn)n>i by k\ := k and Kn+i := 
K„ + K o 6'k„, with the convention that Kn+i = +00 if Kn = +00. For all n > 0, we 
denote by J^^^ the completion with respect to Pq— negligible sets of the o"— algebra 
generated by the events of the form {k„ = t} n A, for all t £ N, and A £ Tt- 

The following two propositions are analogous respectively to Theorem 1.4 and 
Corollary 1.5 of [TH]. Given Lemma [T] and Lemma [2] the proofs are completely 
similar to those presented in [T3], noting that the process (/?(n), X„)„gN is strongly 
Markov, so we omit them, and refer the reader to |13j . 

Proposition 2. For every n > 1, Po('^n < +00) = 1. Moreover, for every A £ T , 
the following equality holds F^—a.s. 

(2) Po {X o e^,^ G A\J^^J = Po (X G A\D = +CX)) . 

Proposition 3. With respect to Pq, the random variables ni, K2 — K1, K3 — K2, . . . are 

independent, and, for all k > 1, the distribution of ki^^i — k^ with respect to Pq is that 
of K with respect to Pq conditional upon D = +00. Similarly, the random variables 
Xi^^, — Xi^^, — Xk2, . . . are independent, and, for all k >1, the distribution 
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of -'^ftfe+i — ^Kfc with respect to Pq is that of with respect to Pq conditional upon 
D = +00. 

For future reference, we state the following result. 

Lemma 3. On Sk < +00, the conditional distribution of the sequence (Xj — 
Xsf.)sk<i<Dk with respect to J^Su ^-^ ihe same as the distribution of (Xj)o<j<D with 
respect to Pq. 

Proof. Observe that between times and the walk never visits any site that it 
has visited before time S^. Therefore, applying the strong Markov property to the 
process (/3(n), X„)„gN and spatial translation invariance, we conclude the proof. □ 

A consequence of Proposition [T] is that ¥jq{k\D = +00) < +00 and EodX^HD = 
+00) < +00. Since Po(k > 1) = 1 and Po(X«; • d > 1) = 1, ¥.q{k\D = +00) > 
and Eo(X«; • ei\D = +co) > 0. Letting v{p,d) := ^°'i^l^\D=+^)^'^ ^ see that 
< v{p, d) < +00. 

The following law of large numbers can then be proved, using Proposition [3j 
exactly as Proposition 2.1 in [13], to which we refer for the proof. 

Theorem 2. Under Pq, the following limit holds almost surely: 

lim n^^Xn ■ ei = v{p, d). 

n— ++00 

Another consequence of Proposition [l] is that Kq^k^ID = +00) < +00 and 

MMD = +00) < +00. Letting a\p,d) := ^"^'""-l^.^^fe'Vlr^""^ ' 
that a{p,d) < -j-oo. That a{p,d) > is explained in Remark ^ below. 

The following functional central limit theorem can then be proved, using Propo- 
sition [sj exactly as Theorem 4.1 in [12 , to which we refer for the proof. 

Theorem 3. Under Pq, the following convergence in distribution holds: as n goes 
to infinity, 

t ^ rr'^/'^{X\nt\ ■ ei -v[nt\), 
converges to a Brownian motion with variance a'^{p,d). 

Remark 1. The fact that a{p,d) > is easy to check. Indeed, we will prove that 
the probability of the event X^ ■ ei ^ vk is positive. There is a positive probability 
that the first step of the walk is +ei, and that Xn • ei > 1 for all n afterwards. 
In this situation, k = 1 and X^ • ei = 1. Now, there is a positive probability that 
the walk first performs the following sequence of steps: +62, —62, +ei, and that then 
Xn • ei > 1 for all n afterwards. In this situation, k = 3 and • ei = 1. 

4. Estimate on the tail of k 

4.1. CoupHng with a simple random walk and tan points. We use the cou- 
pling of the excited random walk with a simple random walk that was introduced 
in [T] , and subsequently used in [71 18] . 

To define this coupling, let {ai)i>i be a sequence of i.i.d. random variables with 
uniform distribution on the set {1,. . . Let also (?7i)i>i be an i.i.d. family of 
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random variables with uniform distribution on [0, 1], independent from (aj)j>i. Call 
{Q,Q,P) the probability space on which these variables are defined. Define the 
sequences of random variables Y = {Yi)i>o and Z = {Zi)i>o taking values in Z*^, 
as follows. First, Iq := and Zq := 0. Then consider n > 0, and assume that 
Yo, ■ ■ ■ ,Yn and Zq, . . . , Zn have already been defined. Let Zn+i ■= Zn + (l(C/n+i < 



1/2) - > l/2))ea^+,. Then, ii Y^ e {Yf, < i < n - 1} or a„+i / 1, 

let Yn+i := Yn + (l(f/n+i < 1/2) - l{Un+i > l/2))ea„+,. Otherwise, let Yn+i := 

Yn + (l(C/n+l <P)- HUn+1 > p))ei. 



The following properties are then immediate: 

• (Zj)j>o is a simple random walk on Z^; 

• {Yi)i>o is an excited random walk on Z'^ with bias parameter p; 

• for all 2 < J < d and i > 0, Yi ■ ej = Zi ■ ej; 

• the sequence {Yi, ■ ei — Zi ■ ei)j>o is non-decreasing. 

Definition 1. If {zi)i>o E Sq, we call an integer n > an (ei,e2)~tan point index 
for the sequence {zi)i>o if z^-ei > z^-ei for allO < k < n—1 such that Zn-e2 = Zk-e2- 

The key observation made in [1^ is the following. 

Lemma 4. If n is an (ei,e2)-tan point index for {Zi)i>Q, then Yn ^ {Yi] < i < 
n-1}. 

Proof. If n is an (ei, e2)-tan point index and if there exists an ^ G {0, . . . , n— 1} such 
that Yn = Yi, then observe that, using the fact that Zi-e2 = Y£-e2 and Zn-e2 = Yn-e2, 
we have that Zi ■ e2 = Zn ■ €2- Hence, by the definition of a tan point we must have 
that Zi - ei < Zn - ei, whence Yn ■ ei — Zn ■ ei < Yi ■ ei — Zg ■ ei. But this contradicts 
the fact that the coupling has the property that Yn ■ ei — Zn ■ ei > 1^ • ei — • ei. 



Let H := {i > 1; cti £ {1,2}}, and define the sequence of indices (Ii)j>o by 
/o := 0, lo < /i < /2 < • • • , and {/i,/2, . . .} = H. Then the sequence of random 
variables (Wj)j>o defined by Wi := (Z/^ • ei, Zj. ■ 62) forms a simple random walk on 



If i and n are such that Jj = n, it is immediate to check that n is an (ei, e2)-tan 
point index for {Zk)k>o if and only if i is an (ei, e2)-tan point index for the random 
walk {Wk)k>o- 

For all n > 1, let Nn denote the number of (ei,e2)-tan point indices of (Wk)k>o 
that are < n. The arguments used to prove the following lemma are quite similar 
to the ones used in the proofs of Theorem 4 in [Tj and Lemma 1 in [8], which are 
themselves partly based on estimates in [3j. 

Lemma 5. For all < a < 3/4, as n goes to infinity, 



□ 



Z2. 
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Proof. For all G Z \ {0}, m > 1, consider the three sets 
r(r?i)fc := Z X 

A(m)fc := Zx {{2k-l)[m^/^\,{2k + l)[m'^/^\), 
@{m)k := {v e A{m)k; \v 62] >2k[m^/'^\}. 

Let x("^)fc be the (a.s. finite since the simple random walk on is recurrent) 
first time when (Wi)i>o hits T(m)k- Let <p{m)k be the (again a.s. finite for the same 
reason as xW^)k) first time after x{^)k when (Wi)i>o leaves A(m)fc. Let Mj.{m) 
denote the number of time indices n that are (ei, e2)~tan point indices, and satisfy 
x(m)fc < n < (t){m)k - 1 and Wn G Q{m)k. 

Two key observations in fll (see Lemma 2 in [Ij and the discussion before its 
statement) are that: 

• the sequence (Mfc(m))fcggy{o} is i.i.d.; 

• there exist ci,C2 > such that P(Mi(m) > civn?/^) > C2- 

Now, consider an e > such that b := 1/3 — 4a/9 — e > 0. let m„ := 
[(n^/ci)"^/^] + 1, and let K := 2{\n^] + l)[my^J. Note that, as n ^ +00, 
(hnf ~ (4 )n3"''9" 2"^. Let i?n,+ and Rn - denote the following events 

Rn,+ := {for ah G {1, . . . ,+\n'']}, Mk{mn) < cim^/^}, 

and 

Rn,- := {foranfce{-rn''l,...,-l}, Mfc(m„) <cim3/4}. 

From the above observations, P{Rn,+ U Rn-) < 2(1 — 02)'^" ^ ■ 
Let g„ := [n(/i„)~^J, and let Vn be the event 

Vn := {for all i G {0, . . . , n}, -/i„ < • 62 < +/in}- 

By Lemma [6] below, there exists a constant C3 > such that, for all large enough 
n, all — /i„ < y < +/i„, and x G Z, the probability that a simple random walk on 
1? started at (a:, y) at time zero leaves Z x {— /i^j • • • , +^n} before time /i^, is larger 
than C3. A consequence is that, for all q > 0, the probability that the same walk 
fails to leave Z x {— . . . , +/in} before time qh"^ is less than (1 — c^Y . Therefore 
P{Vn) < (l-ca)"?". 

Observe now that, on V^, 

n > max((/)(m„)fc; 1 < A; < \n^~\) or n > max(0(m„)fc; — [n*] < k < —1). 

Hence, on V^, 

A^n > X] or iV„ > Mkinin). 

k=l k=-l 

We deduce that, on i?^ + n R^ _ D V^, Nn > cirnr!"^ > n". 

As a consequence, Po(An <' "•'') < Po(^n,+ U _) + Po(K), so that Po(A„ < 
n") <2(l-C2)r"'T +(1-03)''" 
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Noting that, as n goes to infinity, Qn ~ nh^^ ~ {Ac^'^^^) ^n^l'^ 4a/9+2e^ ^j^^ zou- 
clusion follows. 

□ 

Lemma 6. There exists a constant C3 > such that, for all large enough h, all 
— h < y < +h, and x G Z, the probability that a simple random walk on started 
at (x, y) at time zero leaves Z x {—h, . . . , before time h"^, is larger than C3. 

Proof. Consider the probability that the 62 coordinate is larger than h at time /i^. 
By standard coupling, this probability is minimal when y = —h, so the central limit 
theorem applied to the walk starting with y = —h yields the existence of C3. 

□ 

Lemma 7. For all < a < 3/4, as n goes to infinity, 

^Q{Jn < n") < exp {-n\ ~ If + . 

Proof. Observe that, by definition, Ik is the sum of k i.i.d. random variables whose 
distribution is geometric with parameter 2/d. By a standard large deviations bound, 
there is a constant ce such that, for all large enough n, P{I\j^^-i\^ > n) < exp(— cgn). 
Then observe that, if ^ ''^j have Jn{Y) > A^[„rf-ij according to Lemma |4] 

above. (Remember that, by definition, Jn(Y) is the number of indices < A; < n 
such that Yfc ^ {Yf, < i < k — 1}. ) Now, according to Lemma |5] above, we have 
that, for all < a < 3/4, as n goes to infinity, 

P(iVLnrf-ij < [nd-'n < exp (^-[nd'^l 5 " t + 

from which it is easy to deduce that for all < a < 3/4, as n goes to infinity, 

/ 1 4a I 

P{Nind-^\ < n") < exp -n3 9 ^ '^y^' . Now we deduce from the union bound 

that P{Jn{Y) < n") < P(/L„d-ij > n) + PiN^^a-i^ < n''). The conclusion follows. 

□ 

4.2. Estimates on the displacement of the walk. 
Lemma 8. For all 1/2 < a < 3/4, as n goes to infinity, 

• ei < n") < exp (^-n^(»)+°(i)' 

where ip{a) := min (| — 2a — l) . 

Proof. Let 7 := ^^^^ • Let (ej)j>i be an i.i.d. family of random variables with 
common distribution n on b, and let (??j)i>i be an i.i.d. family of random variables 
with common distribution on b independent from (ei)i>i. Let us call {^2,G2,Q) 
the probability space on which these variables are defined. 

Define the sequence of random variables {^i)i>o taking values in Z"', as follows. 
First, set ^0 '■= 0. Consider then n > 0, assume that (,0, ■ . ■ ,S,n have already been 
defined, and consider the number Jra(^) of indices < A; < n such that S,k ^ {Cij < 
i < k - 1}. If ^„ ^ {^i; < i < n - 1}, set := ^„ + ej„(^). Otherwise, let 
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:= S,n + ??n_j„(^)+i. It IS easy to check that the sequence {6.n)n>o is an excited 
random walk on Z*^ with bias parameter p. 

Now, according to Lemma [Tj for all 1/2 < a < 3/4, Q(J„ < n") < 

exp ( -n5 ~ T y That for all 1/2 < a < 3/4, Q(J„_i < 27-171^) < 



exp I — n3 9 ~'~ ^ ' 1 is an easy consequence. Now observe that, by definition, 

for n > 1, ^„ = ^^x^ £1 + Y^^=i"~^ Vi- Now, there exists a constant C4 such that, 
for all large enough n, and every 27" ^n" < A: < n, 

Q ^ ei • ei < (3/2)n" j < Q ^ • ei < |7A:^ < exp {-c^n^) , 

by a standard large deviations bound for the sum Y2i=i ' ^i; whose terms are i.i.d. 
bounded random variables with expectation 7 > 0. By the union bound, we see that 

Q -ei < (3/2)n"j < nexp (-C4n'') + exp (^-n^ ~ f + '^(1)^ . 

Now, there exists a constant C5 such that, for all large enough n, and for every 
1 < k < n, Q (Yli=i ■ ei < — (l/2)n°^ < exp (— csn^""^) , by a standard Gaussian 
upper bound for the simple symmetric random walk on Z. 

By the union bound again, we see that Q ^« • ei < — (l/2)n°^ < 

nexp (— csn^""^). The conclusion follows. 

□ 

Lemma 9. As n goes to infinity, 

{n<D < +00) < exp 



Proof. Consider 1/2 < a < 3/4, and write Po(n < -D < +00) = Y.k=n^o{D = 
k) < Et=n^oiXk • ei = 0) < Et=n^o{Xk ■ ei < fc"). Now, according to 
Lemma [sj Po(^fc • ei < /c") < exp (-fe'^^'^^+^^i)). It is then easily checked that 
Efc:S^exp < exp(-n'^('*)+''(i)). As a consequence, Fo{n < D < 

+00) < exp (-n'^(")+°(i)). Choosing a so as to minimize ip{a), the result follows. 

□ 

4.3. Proof of Proposition [l| Let 01,02,03 be positive real numbers such that 
oi < 3/4 and 02 + 03 < oi. For every n > 0, let m„ := [n^^J, Vn '■= [n^^J, Wn := 
[n'^^l . In the sequel, we assume that n is large enough so that Vn{wn + 1) + 2 < m„. 
Let 

An := {Xn ■ ei < n„}; 5„ := Q {Dk < +00}; C„ := |J {u;„ < Dk - Sk < +00}. 

fc=0 /k=0 
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(With the convention that, in the definition of Cn, — Sk = +00 whenever = 
+00.) We shall prove that {k > n} C An U Bn U C„, then apply the union bound to 
Po(AnUi?nUCn), and then separately bound the three probabilities Po(^n)) ^oiBn), 
Po(C„). 

Assume that A'^n B^n occurs. Our goal is to prove that this assumption 
implies that k < n. 

Call M the smallest index k between and Vn such that = +00, whose 
existence is ensured by B^. By definition, k = Sm-, so we have to prove that 
Sm < n. For notational convenience, let D-i = 0. By definition of M, we know 
that Dm-1 < +00. Now write r^^.i = Ylk'jo^i'^Dk - "^sj + {rs^ - rok-i), with the 
convention that X^^^g ~ Since the walk performs nearest-neighbor steps, we see 
that for all < /c < M — 1, r£)^ — r^^ < Df. — S^- On the other hand, by definition, 
for all < /c < M - 1, r^^ - rD^_^ = 1. Now, for all < k < M - 1, Dk - Sk < Wn, 
due to the fact that holds and that Dk < +00. As a consequence, we obtain that 
^Dm-i — ^{'^n + 1) < Vn{wn + !)• Remember now that Vn{wn + 1) + 2 < Un, so we 
have proved that, r£)j^j_^ + 2 < Un- Now observe that, on A^'^, Xn • ei > u„. As a 
consequence, the smallest i such that Xi ■ ei = r^^^^^ + 1 must be < n. But Sm is 
indeed the smallest i such that Xi - ei = ?^Djv/-i + ^o we have proved that Sm < n 

on A^^nai^nc^. 

The union bound then yields the fact that, for large enough n, Po('^ ^ n) < 

Fo{An)+Fo{Bn)+Fo(Cn). 

Now, from Lemma M we see that Po(An) ^ exp(— n'^^"^^^"^"'^^). By repeatedly 
applying Lemma [2] and the strong Markov property at the stopping times Sk for 
k = 0, . . . ,Vn to the process (/?(n), we see that Fo{Bn) < Po(-D < +00)''". 
Hence, from Lemma [T] we know that Po(i?n) < (1 — SY". 

From the union bound and Lemma [s] we see that Po(Cn) < (fn + l)Po(^^n < ^ < 
+00), so, by Lemmajol Po(C„) < {vn + 1) exp{-n''^/^'^+°^^^). 

Using Lemma [8j we finally obtain the following estimate: 

Po(k > n) < (1 - 5)^""'^ + (K'J + l)exp (^-n'^^/^+^^i)) + exp (^-n'''('^i)+°(i)) . 

Now, for all e small enough, choose ai = 12/19, 02 = 1/19, 03 = 11/19 — e. This 
ends the proof of Proposition [T} 



5. Simulation results 

We have performed simulations of the model in dimension d = 2, using a C code 
and the Gnu Scientific Library facilities for random number generation. 

The following graph is a plot of an estimate of v{p,2) as a function of p. Each 
point is the average over 1000 independent simulations of (^loooo • ei)/10000. 
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The following graph is a plot of an estimate of a{p, 2) as a function of p. 
Each point is the standard deviation over 1000000 independent simulations of 
(Xioooo • ei)/(10000)^/^ (obtaining a reasonably smooth curve required many more 
simulations for a than for v). 
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